Statistical Significance Tests: Equivalence and Reverse Tests Should Reduce Misinterpretation

Statistical significance tests.

Statistical methods for the analysis of data can be classed as descriptive or as probabilistic. The former methods include tabulation and graphical display, of great importance both in detailed analysis and also in presentation of conclusions. Probability enters statistical analysis in various ways. The most obvious is that one recognizes explicitly that conclusions drawn from limited data are ...

Ababacar MBENGUE 2010 Should we burn the statistical significance tests ?

M@n@gement Copies of this article can be made free of charge and without securing permission, for purposes of teaching, research, or library reserve. Consent to other kinds of copying, such as that for creating new works, or for resale, must be obtained from both the journal editor(s) and the author(s). M@n@gement is a double-blind refereed journal where articles are published in their original...

Which statistical tests should I use?

Statistical tests can be powerful tools for researchers. They provide valuable evidence from which we make decisions about the significance or robustness of research findings. Statistical tests are a critical part of the answers to our research questions and ultimately determine how confident we can be in the evidence to inform clinical practice. In addition to analysing data to answer research...

Statistical Tests, Tests of Significance, and Tests of a Hypothesis Using Excel

Statistical Significance Tests for Machine Translation Evaluation

If two translation systems differ differ in performance on a test set, can we trust that this indicates a difference in true system quality? To answer this question, we describe bootstrap resampling methods to compute statistical significance of test results, and validate them on the concrete example of the BLEU score. Even for small test sizes of only 300 sentences, our methods may give us ass...